38931S2 

HYPER-ARC CONSISTENCY IN A CONTRAINT SATISFACTION NETWORK 



FIELD OF THE INVENTION 



The present invention relates generally to solving 
constraint satisfaction problems, and specifically to 
5 methods and systems for solving such problems by 
maintaining arc consistency. 



Many of the tasks that are addressed by 
decision-making systems and artificial intelligence can 

10 be framed as constraint satisfaction problems. In this 
framework, the task is specified in terms of a set of 
variables, each of which can assume values in a given 
domain, and a set of predicates, or constraints, that the 
variables must simultaneously satisfy. The set of 

15 variables and constraints is referred to as a constraint 
network. Each constraint may be expressed as a relation, 
defined over some subset of the variables, denoting valid 
combinations of their values . A solution to the problem 
is an assignment of a value to each variable from its 

20 domain that satisfies all of the constraints. 

Constraint satisfaction methods have been found 
useful in a variety of applications, including: 
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Artificial intelligence 



Robotic control 



25 



Temporal reasoning 



Natural language parsing 



Spatial reasoning 

Test generation for software and hardware systems 



Machine vision 



30 



Medical diagnosis 
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• Resource allocation 

• Crew scheduling 

• Time tabling 

• Frequency allocation 
5 • Graph coloring. 

For example, Lewin et al . describe a constraint 
satisfaction method for use in automated testing of 
memory access, in a paper entitled "Constraint 
Satisfaction for Test Program Generation,'' in the 

10 proceedings of the IEEE 14th International Phoenix 
Conference on Computers and Communications (1995) , pages 
45-48, which is incorporated herein by reference. The 
authors use a constraint satisfaction algorithm to 
generate addresses and memory access instructions that 

15 provide effective verification of the design of a 
computer processor. 

The constraint network can be viewed as a 
hypergraph, having a node for each variable and a 
hyper-edge for each constraint. These hyper-edges are 

20 referred to as arcs, wherein the members of such an arc 
are the variables that appear in the constraint to which 
the arc corresponds. An arc is said to be consistent if 
for any variable of the arc, and any value in the domain 
of the variable, there is a valid assignment of values to 

25 the other variables on the arc that satisfies the 
constraint represented by the arc. If every arc in the 
hypergraph is consistent, then the network is said to be 
arc-consistent . 

In large networks, an exhaustive search for valid 

3 0 assignment of the variables can be extremely 
time-consuming. Various methods have been used to 
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improve the efficiency of the search, such as pruning the 
search tree before or during the search, decision 
algorithms for choosing the next variable to instantiate 
or the next value to choose for the variable, and 
5 backtrack algorithms for deciding where to resume the 
search after reaching a "dead end." 

Recent research suggests that the most efficient 
general solutions for constraint satisfaction problems 
are algorithms based on maintaining arc consistency. 

10 These algorithms were introduced by Mackworth in an 
article entitled "Consistency in Networks of Relations," 
published in Artificial Intelligence 8, pages 99-118 
(1977), which is incorporated herein by reference. Arc 
consistency algorithms are based on the observation that 

15 given variables v x and v 2 , with discrete domains Di and D 2 , 
if x € D lf and there is no y e D 2 that satisfies a given 
constraint P i3 imposed on v 1 and v 2 , then x can be deleted 
from Di. This basic action of arc consistency algorithms 
is embodied in the Boolean procedure "REVISE": 

20 

procedure REVISE (( i, j )) : 
begin 

DELETE <- false 
for each x e D± do 
25 if there is no y s Dj such that P i;j (x,y) 

then 

begin 

delete x from D L ; 
DELETE <r- true 

3 0 end 
return DELETE 
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end 

It is also necessary, of course, that the variables have 
single node consistency, i.e., that they satisfy any 
5 applicable unary predicates in the constraint network. 
Mackworth also defines a simple procedure NC(i) for 
testing single node consistency. 

Whenever REVISE is successful (i.e., when it results 
in reducing the domain of one of the nodes of the arc) , 

10 it is necessary to determine whether the other arcs of 
the graph (G) are still consistent, and to REVISE their 
node domains as required to maintain consistency. 
Mackworth points out that it is not necessary to apply 
REVISE to all of the arcs in the graph, but only to those 

15 arcs for which the result of applying REVISE could 
possibly be changed from false to true. Thus, the arcs 
are maintained in a queue (Q) , and the following 
algorithm is used to reapply REVISE to any of the arcs in 
the queue for which it is appropriate: 

20 

begin 

for i <- 1 until n do NC(i); 
Q <r- {(i,j)l(i,j) e arcs(G) , i * j } 
while Q not empty do 
25 begin 

select and delete any arc (k,m) from 
Q; 

if REVISE ((k,m)) then Q «- Q u 

{ (i, k) | (i, k) e arcs (G) , i * k, i * m} 

30 end 
end 
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Arc consistency algorithms may also be generalized 
to non-binary constraints, as described by Mackworth, for 
example, in an article entitled "On Reading Sketch Maps," 

- 5 in Proceedings of the International Joint Conference on 
Artificial Inzelligence (1977), pages 598-606. Other 
algorithms for maintaining arc consistency are also known 
in the art. A recent survey of these algorithms is 
presented by Bessiere et al . , in "Using Constraint 

10 Metaknowledge to Reduce Arc Consistency Computation," 
published in Artificial Intelligence 107(1), pages 
125-148 (J999). Both of these articles are incorporated 
herein by reference. 

Methods known in the art for solving constraint 

15 networks by maintaining arc consistency require that a 
constraint be given as a logical relation, represented as 
an explicit set of valid combination of variable values, 
or revealed through a predicate. Consequently, solutions 
of this type have been limited to problems and 

20 constraints for which this representation is feasible and 
provides for practical manipulation. Known methods 
suggest general schemes for consistency maintenance. A 
concrete consistency maintenance procedure should be 
reconstructed, following the given scheme, per 

25 constraint, or in some cases per constraint network. It 
is thus desirable to have a language for specifying 
constraints, and to be able to provide an automatic 
procedure for constructing consistency maintenance 
procedures for constraints specified using this language. 

30 A rudimentary grammar for constraint expressions is 
described by Offutt, in "An Integrated Automatic Test 
Data Generation System," published in Journal of Systems 
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Integration 1(3), pages 391-409 (1991), which is 
incorporated herein by reference. This scheme, however, 
deals only with unary constraints and is not suitable for 
maintaining arc consistency. 
5 A number of constraint satisfaction systems are 

described in the patent literature. For example, U.S. 
Patent 5,636,328, whose disclosure is incorporated herein 
by reference, describes methods and apparatus for finding 
values that satisfy a set of constraints, applied 

10 particularly to control of a robotic arm. The technique 
described in this patent is used in local search 
procedures for finding such constraint-satisfying values, 
with the aim of overcoming the tendency of such local 
search procedures to "get stuck" at certain points in the 

15 search. The technique dynamically adds weight to 
constraints in the set which are not satisfied by the 
current set of values and uses the weights of the 
constraints to determine the next set of values to be 
used in the local search. It is thus, essentially, a 

20 statistical method for solving constraint satisfaction 
problems, rather than an analytical method for 
maintaining arc consistency. 

As another example, U.S. Patent 5,617,510, whose 
disclosure is also incorporated herein by reference, 

25 describes a method, useful in computer-aided design, of 
identifying possible solutions to an over-constrained 
system having a collection of entities and constraints. 
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SUMMARY OF THE INVENTION 

Preferred embodiments of the present invention 
provide a general procedure for computing arc consistency 
on a single hyper-edge of a constraint network. The 
5 procedure is applicable not only to binary (two-variable) 
constraints, but also to constraints involving three or 
more variables. Embodiments of the present invention 
provide a method to construct an automatic procedure for 
computing arc consistency for declaratively-described 

10 constraints. The automatic procedure supports every 
constraint expression derived from a given context-free 
grammar. The declarative representation selected for 
constraints is implicit, i.e., it does not require 
explicit enumeration of the tuples allowed by the 

15 constraint. 

The constraint representation method and the 
computation procedure make it feasible to handle large 
and complex constraint relations defined over very large 
variable domains. They are applicable to constraints 

20 that are constructed from substantially any combination 
of operators, preferably including logical, arithmetic 
and bitwise operators, and including both linear and 
non-linear constraints. Thus, the present invention 
broadens the applicability of constraint network 

25 solutions based on maintaining arc consistency to types 
of problems that were previously intractable. The 
inventors have found the present invention to be 
particularly useful in automatic test generation for 
hardware and software systems, but it can similarly be 

30 applied to other types of constraint satisfaction 
problems, as are known in the art. 
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In preferred embodiments of the present invention, a 
generic relational language is defined, enabling a user 
to express constraints in a constraint satisfaction 
problem by declarative description, rather than as 
5 explicitly enumerated logical relations or as ad hoc 
consistency computation procedures. The grammar of the 
language allows arbitrary combinations of arithmetic, 
logical and bitwise operators, to be used in describing 
the constraints. Based on this language, each complex 

10 constraint, or arc, in the overall constraint network is 
transformed into a sub-network of hyper-edges, labeled 
with the operators of the language, with nodes 
representing the domains of the variables on the arc. 
The domains are reduced successively until global 

15 consistency is achieved over all the hyper-edges of the 
sub-network. Global consistency on the sub-network 
assures that arc consistency is maintained on the arc 
corresponding to the original complex constraint. 

In order to achieve this global hyper-arc 

20 consistency, each sub-network is preferably decomposed 
into a set of trees, having operators and variables as 
nodes. Each tree is traversed in an orderly way, and the 
domains of the variables on the tree are reduced, until 
consistency is reached on all the branches of the tree. 

25 Traversal of the trees is based on a process of 
projecting the domains of the input variables of each 
operator onto the output variables, and vice versa, until 
the precise domains of all of the variables are 
determined. Once arc consistency is achieved for a tree, 

30 the tree becomes globally consistent, as well. The 
domains of the variables on all of the trees in the set 
are then combined to generate a maximal 
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' globally-consistent reduction of the domain of the 
original network. This decomposition procedure is most 
conveniently applied in constraint networks that are 
defined using the above-mentioned relational language, 
5 but it may also be used in arc consistency computations 
based on other grammars, or which are based on relations 
and operators of other types. 

There is therefore provided, in accordance with a 
preferred embodiment of the present invention, a method 
10 for solving a constraint satisfaction problem, including: 
receiving a set of variables having respective input 
domains and a set of relations among the variables; 

building a network of one or more hyper-arcs 
representative of the set of relations, each hyper-arc 
15 corresponding to one of the relations and linking nodes 
in the network corresponding to the variables that are 
subject to the relation; 

for each of the hyper-arcs, assembling the variables 
in a hierarchy based on the relation corresponding to the 
20 hyper-arc; and 

reducing the input domains of the variables in the 
hierarchy, so as to determine respective output domains 
of the variables that are consistent with the relations. 

Preferably, assembling the variables includes 
25 arranging the variables in a hierarchical graph, having 
vertices corresponding to the variables and having the 
form of one or more trees. Further preferably, reducing 
the input domains includes reducing the input domains 
over each of the trees so as to find respective interim 
30 domains of the variables that are consistent with the 
relation over each of the trees, and combining the 
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interim domains over all of the trees to determine the 
output domains . 

Additionally or alternatively, receiving the set of 
relations includes receiving a definition of the 
5 relations as a combination of operators, selected from a 
group of arithmetic, bitwise and logical operators, which 
are applied to the variables, and arranging the variables 
in the graph includes inserting vertices in the graph 
corresponding to the operators, connecting the vertices 

10 corresponding to the variables. Preferably, reducing the 
input domains includes finding projections of the 
operators onto the domains of the variables in the graph. 
Most preferably, receiving the set of variables includes 
receiving an output variable and at least one input 

15 variable for each of the operators, and finding the 
projections includes projecting the domain of the at 
least one input variable of each of the operators onto 
the domain of the output variable thereof, and projecting 
the domain of the output variable of each of the 

20 operators onto the domain of the at least one input 
variable thereof. 

In a preferred embodiment, building the network of 
the hyper-arcs includes representing the set of relations 
as a disjunction of multiple relations, with one of the 

25 hyper-arcs corresponding respectively to each of the 
relations, wherein determining the respective output 
domains includes determining interim domains of the 
variables for each of the hyper-arcs, and taking a union 
of the interim domains for each of the variables to 

30 determine the output domains. 

Preferably, reducing the input domains includes 
determining the output domains such that for any given 
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value in the respective output domain of each, of the 
variables, there exist values of the other variables in 
the respective output domains thereof that, together with 
the given value, constitute a solution to the set of 
5 relations. Additionally or alternatively, reducing the 
input domains includes determining the output domains 
such that every set of values of the variables in the 
input domains that constitutes a solution to the set of 
relations is contained in the output domains of the 

10 variables. 

In a preferred embodiment, receiving the set of 
relations includes receiving a relation relating to at 
least three of the variables. 

In a further preferred embodiment, receiving the set 

15 of variables includes receiving variables that are 
characteristic of inputs to a system under test, and 
reducing the input domains includes determining values of 
the inputs to be made to the system based on the output 
domains of the variables. Typically, the system includes 

20 an electronic processor, and determining the values of 
the inputs includes determining commands and addresses to 
be input to the processor. 

In another preferred embodiment, receiving the set 
of variables includes receiving control parameters of a 

25 mechanical system, and reducing the input domains 
includes generating a command to control the system based 
on the output domains of the parameters. 

In still another preferred embodiment, receiving the 
set of variables includes receiving features of an image 

30 containing visual information, and reducing the input 
domains includes identifying an object in the image based 
on the features . 
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In yet another preferred embodiment, receiving the 
set of variables includes receiving a natural language 
input, and reducing the input includes parsing the 
natural language, responsive to the output domains, so as 
5 to interpret the language. 

In a further preferred embodiment, receiving the set 
of variables includes receiving characteristics of a 
condition, and reducing the input domains includes 
determining a diagnosis of the condition based on the 
10 output domains. 

In an additional preferred embodiment, receiving the 
set of variables includes receiving characteristics of 
resources whose use is to be scheduled, and reducing the 
input domains includes scheduling the use of the 
15 resources subject to the set of relations. 

There is also provided, in accordance with a 
preferred embodiment of the present invention, a method 
for solving a constraint satisfaction problem, including: 

receiving a set of variables having respective input 
20 domains and a set of constraints including a relation 
among at least three of the variables; 

building a network of one or more hyper-arcs 
representing the constraints, the hyper-arcs including 
nodes representing the variables, one of the hyper-arcs 
25 corresponding to the relation among the at least three 
variables; and 

reducing the input domains of the variables in the 
network of hyper-arcs, so as to determine respective 
output domains of the variables that are consistent with 
30 the set of constraints. 
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There is additionally provided, in accordance with a 
preferred embodiment of the present invention, a method 
for solving a constraint satisfaction problem, including: 

receiving a set of variables having respective input 
5 domains and a set of constraints including one or more 
relations defined as a combination of operators, selected 
from a group of arithmetic, bitwise and logical 
operators, which are applied to the variables; 

building a network of one or more hyper-arcs 
10 representing the set of constraints, each hyper-arc 
corresponding to one of the relations expressed in terms 
of the operators and linking nodes in the network 
corresponding to the variables to which the operators are 
applied; and 

15 reducing the input domains of the variables in the 

network responsive to the operators, so as to determine 
respective output domains of the variables that are 
consistent with the set of constraints. 

Preferably, receiving the set of constraints 

20 includes providing a language for specifying the 
constraints, the language having grammatical rules, and 
specifying the constraints using the language. 

Preferably, the operators include multi-variable 
operators, which receive two of more of the variables as 

25 their inputs. Further preferably, the multi-variable 
operators include one or more operators selected from a 
group consisting of addition, subtraction, 

multiplication, division and modulo operators. 
Additionally or alternatively, the multi-variable 

30 operators include one or more operators selected from a 
group consisting of an operator testing equality of two 
of the variables, an operator testing inequality of two 
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of the variables, and an operator testing whether one of 
the variables is greater than another of the variables. 
Further additionally or alternatively, the multi-variable 
operators include one or more operators selected from a 
5 group consisting of a bitwise "and," bitwise "or" and 
bitwise "exclusive or" operations. 

There is further provided, in accordance with a 
preferred embodiment of the present invention, apparatus 
for solving a constraint satisfaction problem, including 

10 a constraint processor, arranged to receiving a set of 
variables having respective input domains and a set of 
constraints including one or more relations among the 
variables, to build a network of one or more hyper-arcs 
representative of the set of constraints, each hyper-arc 

15 corresponding to one of the relations and linking nodes 
in the network corresponding to the variables that are 
subject to the relation and for each of the hyper-arcs, 
to assemble the variables in a hierarchy based on the 
relation corresponding to the hyper-arc, and to reduce 

20 the input domains of the variables in the hierarchy, so 
as to determine respective output domains of the 
variables that are consistent with the set of 
constraints . 

There is moreover provided, in accordance with a 
25 preferred embodiment of the present invention, apparatus 
for solving a constraint satisfaction problem, including 
a constraint processor, arranged to receive a set of 
variables having respective input domains and a set of 
constraints including a relation among at least three of 
30 the variables, to build a network of one or more 
hyper-arcs representative of the set of constraints, 
including a hyper-arc corresponding to the relation among 
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the at least three variables and linking nodes in the 
network corresponding to the variables that are subject 
to the relation, and to reduce the input domains of the 
variables in the network of hyper-arcs, so as to 
5 determine respective output domains of the variables that 
are consistent with the set of constraints. 

There is furthermore provided, in accordance with a 
preferred embodiment of the present invention, apparatus 
for solving a constraint satisfaction problem, including 

10 a constraint processor, arranged to receive a set of 
variables having respective input domains and a set of 
constraints including one or more relations defined as a 
combination of operators, selected from a group of 
arithmetic, bitwise and logical operators, which are 

15 applied to the variables, to build a network of one or 
more hyper-arcs representative of the set of constraints, 
each hyper-arc corresponding to one of the relations 
expressed in terms of the operators and linking nodes in 
the network corresponding to the variables to which the 

20 operators are applied, and to reduce the input domains of 
the variables in the network responsive to the operators, 
so as to determine respective output domains of the 
variables that are consistent with the set of 
constraints . 

25 There is also provided, in accordance with a 

preferred embodiment of the present invention, a computer 
software product for solving a constraint satisfaction 
problem, the product including a computer-readable medium 
in which program instructions are stored, which 

30 instructions, when read by a computer, cause the 
computer, upon receiving a set of variables having 
respective input domains and a set of constraints 
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• including one or more relations among the variables, to 
build a network of one or more hyper-arcs representative 
of the constraint, each hyper-arc corresponding to one of 
the relations and linking nodes in the network 
5 corresponding to the variables that are subject to the 
relation and, for each of the hyper-arcs, to assemble the 
variables in a hierarchy based on the relation 
corresponding to the hyper-arc, and to reduce the input 
domains of the variables in the hierarchy, so as to 

10 determine respective output domains of the variables that 
are consistent with the set of constraints. 

There is additionally provided, in accordance with a 
preferred embodiment of the present invention, a computer 
software product for solving a constraint satisfaction 

15 problem, the product including a computer-readable medium 
in which program instructions are stored, which 
instructions, when read by a computer, cause the 
computer, upon receiving a set of variables having 
respective input domains and a set of constraints 

20 including a relation among at least three of the 
variables, to build a network of one or more hyper-arcs 
representative of the set of constraints, including a 
hyper-arc corresponding to the relation among the at 
least three variables and linking nodes in the network 

25 corresponding to the variables that are subject to the 
relation, and to reduce the input domains of the 
variables in the network of hyper-arcs, so as to 
determine respective output domains of the variables that 
are consistent with the set of constraints. 

30 There is further provided, in accordance with a 

preferred embodiment of the present invention, a computer 
software product for solving a constraint satisfaction 
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problem, the product including a computer-readable medium 
in which program instructions are stored, which 
instructions, when read by a computer, cause the 
computer, upon receiving a set of variables having 
5 respective input domains and a set of constraints 
including one or more relations defined as a combination 
of operators, selected from a group of arithmetic, 
bitwise and logical operators, which are applied to the 
variables, to build a network of one or more hyper-arcs 

10 representative of the set of constraints, each hyper-arc 
corresponding to one of the relations expressed in terms 
of the operators and linking nodes in the network 
corresponding to the variables to which the operators are 
applied, and to reduce the input domains of the variables 

15 in the network responsive to the operators, so as to 
determine respective output domains of the variables that 
are consistent with the set of constraints. 

The present invention will be more fully understood 
from the following detailed description of the preferred 

20 embodiments thereof, taken together with the drawings in 
which : 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a schematic, pictorial illustration of a 
system for solving constraint satisfaction problems, in 
25 accordance with a preferred embodiment of the present 
invention; 

Fig. 2 is a graphic illustration showing projection 
of a relation onto the domains of its input variables; 

Fig. 3 is a flow chart that schematically 
30 illustrates a method for attaining arc consistency on an 
arc in a complex constraint network, in accordance with a 
preferred embodiment of the present invention; 
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Figs. 4 and 5 are graphic representations of 
exemplary relations in a constraint network, in 
accordance with a preferred embodiment of the present 
invention; 

5 Fig. 6 is a graphic representation of a 

decomposition of a complex relation in a constraint 
network, in accordance with a preferred embodiment of the 
present invention; 

Fig. 7 is a flow chart that schematically 
10 illustrates a method for determining the domains of 
variables in a tree structure representing a hyper-arc in 
a complex constraint network, in accordance with a 
preferred embodiment of the present invention; 

Figs. 8A through 8D are graphic representations of a 
15 complex relation in a constraint network, illustrating 
stages in a method for decomposition of the relation, in 
accordance with a preferred embodiment of the present 
invention; and 

Fig. 9 is a flow chart that schematically 
20 illustrates a method for finding the projections of an 
arbitrary Boolean expression in a constraint network, in 
accordance with a preferred embodiment of the present 
invention . 
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DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Fig. 1 is a schematic pictorial illustration of a 
system 20 for solving constraint satisfaction problems, 
in accordance with a preferred embodiment of the present 
5 invention. The system receives a definition of a set of 
variables and a network of constraints to be applied to 
those variables, preferably in the form of input from a 
user of the system in a special operator grammar, as 
described below. The system then finds solutions to the 

10 constraint network, in the form of values of the 
variables that satisfy all of the constraints. For this 
purpose, the system uses methods of projecting the 
operators onto the domains of the variables while 
maintaining arc consistency. For each n-ary constraint, 

15 system 20 reduces the domains of the variables so that 
they hold only those values that may be part of some 
solution, as described in detail hereinbelow. 

In a preferred embodiment of the present invention, 
by way of example, the variables comprise possible inputs 

20 to a hardware device or software program under 
development. These inputs are typically instructions and 
addresses that would be input to the device or program in 
normal operation. System 20 uses the constraints 

provided by the operator, and/or constraints that it 

25 computes automatically itself, to determine combinations 
of the instructions and addresses to use as test inputs 
to the device. These inputs may then be applied to the 
device or program itself, or they may be input as test 
cases to a simulator for pre-production verification of 

30 the design of the device or program. 

Typically, system 20 comprises a general-purpose or 
dedicated computer, programmed with suitable software for 
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carrying out the functions described herein. The 
software may be supplied to the computer in electronic 
form, over a network or communication link, for example, 
or it may be provided on tangible media, such as CD-ROM 
5 or DVD. 

System 20 can be configured to solve a wide range of 
other types of constraint satisfaction problems, and is 
not limited to the test generation application described 
above. The system may be used, either in the 

10 configuration of a stand-alone computer or integrated 
with other input and output devices, to carry out 
substantially any function that can be associated with a 
constraint networks. Examples of such functions are 
listed in the Background of the Invention, and include 

15 controlling a robot based on sensor inputs; analyzing 
visual or spatial information to identify and 
characterize objects in an image; parsing natural 
language input to interpret its meaning; suggesting 
medical diagnoses based on symptoms and test results; and 

20 determining resource allocations and scheduling. Other 
applications of system 20 will be apparent to those 
skilled in the art. 

Fig. 2 is a plot that schematically illustrates 
projection of a binary constraint, characterized by two 

25 input variables, a and b, defining a Cartesian variable 
space (a x b) 22. The variables are related by a 
relation R, which is satisfied by the variables in a 
solution region 26 in space 22. Each of the variables, 
however, is restricted to a predefined input domain 24, 

30 labeled respectively A and B, so that valid solutions to 
the relation are restricted to an intersection region 27. 
A projection function F is defined as a function that 
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projects region 27 back onto the input domains 24, thus 
generating reduced output domains 28, labeled A' and B' . 
Formally, F accepts as inputs a vector of n sets and a 
n-ary relation among the sets, and outputs a vector of n 
5 sets, wherein each component of the output vector is the 
projection of the solution intersection region (region 
27) back onto che input sets. 

Preferred embodiments of the present invention seek 
to define projection functions F that satisfy the 

10 conditions of "solution preservation" and "solution 
minimization." Solution preservation means that all 
vectors (a,b) falling within intersection region 27 
should be preserved in the Cartesian product of the 
output sets A' and B' . Solution minimization means that 

15 every element in a given output set can be used as a 
coordinate in a vector that falls within solution region 
26 (and necessarily in intersection region 27) . In other 
words, minimization implies that there are no elements in 
the output sets that do not belong to some valid solution 

20 of relation R. 

In preferred embodiments of the present invention, a 
relation R that is input to system 20 is described by a 
hierarchy of variables, constants and operators. The 
operators are defined using a language of functions, 

25 including arithmetic, logical and bitwise functions, 
expressed using a declarative grammar. A typical 

arithmetic function is + : E x E — » E (wherein E is the 
domain on which the operator "+" operates) ; while a 
typical Boolean function is > : E x E -» {true, false}; 

30 and a typical bitwise function is E -> E bit_and E. The 
output of one operator can be used as an input variable 
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to another operator, thus building up the hierarchy that 
defines R. The output of the highest operator in the 
hierarchy is Boolean, so that R can take its place as a 
relation in a constraint network. The user of system 20 
5 can use this language of operators to define complex 
relations among variables, in an orderly way that is then 
used by the system in decomposing the constraints and 
projecting them to determine the output domains of the 
variables, as described below. 
10 In a preferred embodiment of the present invention, 

the grammar provided by system 20 uses the following 
operators, in the order of precedence listed below: 

1. *, / (multiplication, division) 

2. +, - 

15 3. bit_not 

nl 4. bit_xor, bit_and, bit_or 

5. =, jt, <, >, <, > 
: 6. — i (logical not) 

7. a (logical and), v (logical or) 
20 8 . -> (logical imply) 

Table I below lists grammatical rules that apply in using 
the operators to express constraints. Grammar variables 
are written in capital letters, while literal expressions 
are in small letters. The symbol => denotes derivation 
25 (as opposed to logical implication ->) . S is the first 
variable in the grammar, from which any valid word is 
derived . 

TABLE I - OPERATOR GRAMMAR 

S => E 
30 E =^ E = E 
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E => E * E 
E => E > E 
E => E < E 
E => <E) 
E => E + E 
E => E - E 
E ^> E * E 

E => concat(E,E) //concatenation of two bit-vectors 
E => sub_field(E,E / E) //sub-field of a bit-vector 
E => extend (E) //extending a bit-vector to a 

different width 
E => bit_vector_to_int (E, E) //conversion from 

bit-vector domain to integer domain 
E => mod3 (E) 
E => E a E 
E => E v E 
E => — iE 
E => E -» E 
E => E bit_and E 
E => E bit_or E 
E => E bit_xor E 
E => bit_not (E) 
E => ID //variable name 

ID => a|b I c |... //ID is used for variables - any 
sequence of Latin letters is valid 

The inventors have found this grammar to be useful and 
sufficiently complete for defining substantially any 
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constraint network of interest in the field of automatic 
test generation. Variations on this grammar, as well as 
alternative grammars for use in other applications, will 
be apparent to those skilled in the art. 
5 Fig. 3 is a flow chart that schematically 

illustrates a method for projecting a single n-ary 
constraint, given in the grammar described above, in 
accordance with a preferred embodiment of the present 
invention. System 20 typically applies this method to 

10 multiple constraints in a constraint satisfaction 
problem. The constraints correspond to hyper-arcs, which 
are labeled with one of the operators of the language and 
have nodes representing the domains of the relevant 
variables. The objective of the system is to find a 

15 solution to the constraint satisfaction problem by 
achieving global consistency over all of the hyper-arcs, 
based on reducing the domains of the nodes. 

The method of Fig. 3 begins with input of a complex 
constraint as part of a constraint network for solution 

20 by system 20, at a constraint input step 30. The network 
comprises a set of relations, which typically comprise 
complex constraints, and are preferably defined textually 
using the language described above. Each relation thus 
corresponds to an arc in the network. The language 

25 enables system 20 to parse the expression so as to create 
a network (graph), at a parsing step 32. The nodes of 
the graph are operators, variables and intermediate 
variables, as described below. Alternatively, even when 
the constraints are input to system 20 using a different 

30 grammar, the constraints can be parsed into an 
appropriate form. In order to reach hyper-arc 

consistency, the network created at step 32 is decomposed 
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into a set of trees, at a tree generation step 34. When 
consistency is achieved over all of these trees, the 
corresponding hyper-arc will be consistent, as well. 

Fig. 4 is a graph showing an exemplary tree 40 
5 generated in step 34, in accordance with a preferred 
embodiment of the present invention. The vertices of the 
tree correspond to the variables, constants and operators 
used in generating the output y, at an output vertex 42 
of the tree, which is the Boolean result of the relation 

10 a + b = c * d. This relation is referred to herein as a 
"simply-supported relation," since each of the variables 
concerned appears only once. Tree 40 has leaves 44, 
which are vertices corresponding to the input variables 
(or constants), a, b, c and d, each with its respective 

15 domain A, B, C and D. The leaves are connected by 
operator vertices 46, corresponding to the arithmetic 
operators + and *, which have output vertices 48 that are 
respectively labeled xl and x2 . An upper vertex 50 
generates the logical output at vertex 42. 

20 Fig. 5 is another exemplary graph 52, representing a 

relation that is not simply supported, in accordance with 
a preferred embodiment of the present invention. In this 
case, the relation is a + b = b * c, and it will be 
observed that graph 52 is not a tree. Only 

25 simply-supported relations can be represented as trees. 
For non-simply-supported relations (referred to herein as 
"complex-supported relations"), further steps or 
constraints are typically needed in order to achieve 
consistency over the entire graph. For this purpose, 

30 additional information about the variables and operators 
in graph 52 is preferably used to convert the graph into 
a tree . 
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Returning now to Fig. 3, after the complex 
constraint has been transformed into a tree, the 
operators are projected onto the respective variables, at 
a projection step 36, in order to find consistent domains 
5 for all of the variables. As noted above, finding these 
consistent variable domains is equivalent to achieving 
consistency over the entire hyper-arc. The trees are 
preferably stored in a memory of system 20, and can then 
be reused multiple times for projecting different input 

10 sets. After all of the trees have been projected, their 
consistent domains are combined to find 

globally-consistent solutions to the original complex 
arc, at a combination step 38. Such a solution has the 
form of a set of reduced domains of the variables of the 

15 arc that satisfy the solution preservation and 
minimization requirements described above. 

For the purpose of projecting the operators in the 
tree at step 36, each operator of n variables is equipped 
with n+1 auxiliary projection functions: an output 

20 projection function from the n input sets of the operator 
to its output set; and n input projection functions, one 
to each of the n input sets from the output set and the 
n-1 remaining input sets. As a simple example, for the 
above-mentioned operator, + : (a,b) -» c (meaning that a + 

25 b = c) , the projection functions are given by: 

pf? : (S, C) h> {a : b e B, c e C, c = a + b} 

pf+ : (A, C) m> {b : a e A, c e C, c = a + b) ( 1 ) 

prf : (A, b) {c : a s A, b e B, c = a + b) 



26 



38931S2 



The + operator represented by the above equation is 
defined herein as an "atomic operator, " in the sense that 
it has the form y = op: (ai, a 2 , aj , wherein all of the 
a L are distinct variables or constants. In other words, 
5 an atomic relation is a simply-supported relation that 
can be represented by a tree that is a star graph. For 
atomic operators, consistent domains Y' , A' lt A' 2 f -r A' nr 
for all of the variables are found using the auxiliary 
projection functions in an algorithm defined by 
10 assignments (2) below: 



It can be shown that the reduced domains projected using 
15 this algorithm meet the requirements of solution 
preservation and solution minimization described above. 

Figs. 6 and 7 illustrate a recursive method for 
projecting simply-supported non-atomic relations, in 
accordance with a preferred embodiment of the present 
20 invention. This method is preferably used at step 36 in 
the general method of Fig. 3. Fig. 6 is a graph showing 
a tree 60 that represents an arbitrary simply-supported, 
non-atomic relation. Tree 60 has been decomposed to 
isolate a sub-tree 62, corresponding to an atomic 
25 relation based on an operator vertex 64, from a remaining 
portion 66 of the tree. The remainder is schematically 
illustrated here, for the sake of simplicity, as 



Y' <- Y o pf y (A 1 , A 2 , . . 
A\ <e- A 1 n pf Al (a 2 , A 3i 
A 1 2 <r- A 2 n pf A2 (A lr A 3 , 




(2) 



A'„ <- A n n pf^iA^ A z , . . . , A n _ lf Y) 
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corresponding to a relation 68. More generally, however, 
the tree may contain an entire hierarchy of sub-trees, 
and the recursive method described hereinbelow is applied 
to all of them. 

■ 5 Operator vertex 64- has input variables (or 

constants) bi, b 2 , b m , with corresponding domains Bi, 

B 2 , B m and input vertices 70, which are leaves on tree 
60. A vertex 72, labeled X, corresponds to the output 
domain of operator vertex 64. This output domain is one 

10 of the input domains of relation vertex 68, along with 
the domains of other vertices 74, identified as A x , A 2 , 
A P . . The output domain of relation 68, identified as Y a , 
is represented by a vertex 76 of tree 60. 

An example of a relation of the type illustrated by 

15 Fig. 6 is R = {(a,b,c,d) : a = b + c * d} . This relation 
is equivalent to the conjunction of the two relations R x = 
{(a,b,x) : a = b + x} and R 2 = {(x,c,d) : x = c * d} . The 
input domains of a, b, c and d are respectively given as 
A, B, C and D, while the input domain of x is X, which is 

20 initiated to the universal set U of the output type of 
the operator "*". In this case, vertices 70 correspond 
to C and D, vertex 64 to *, vertex 74 to A and B, vertex 
68 to the relation "A + B = X," and vertex 76 to the 
Boolean output of the entire relation, or predicate. 

25 Fig. 7 is a flow chart that schematically 

illustrates a recursive method of domain projection, 
based on the decomposition of tree 60 shown in Fig. 6. 
The method begins at a vertex selection step 80, with 
selection of an operator vertex on the tree, such as 

30 vertex 64, whose input vertices 70 are leaves on the 
tree. The input sets, or domains, Bi, B 2/ B m , of 

vertices 70 are projected onto output vertex 72 of the 
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operator, at an input projection step 82. This step uses 
the appropriate auxiliary projection functions determined 
for the operator, as described above. The result of this 
step is a new, possibly reduced domain X of output vertex 
5 72. 

Step 82 is repeated recursively up the tree to 
vertex 76, at a recursion step 84. The remaining part of 
the relation is projected, potentially reducing the 
operator's output. In the simple example shown in Fig. 

10 6, the newly-generated domain of vertex 72, along with 
the input domains of vertices 74, is projected using the 
same method in a recursive fashion up the tree onto the 
output domain of vertex 76. The different branches of 
the tree are typically processed sequentially, but they 

15 may also be processed in parallel as long as the input 
for every operator is "ready" before it is used. 

After reaching vertex 7 6, the auxiliary projection 
functions are invoked in the reverse direction, down the 
tree, at an output projection step 86. Thus, the 

2 0 newly-determined domain Y'i of vertex 7 6 would be 
projected, along with domains A'i, A' n , using the 

projection functions of vertex 68, to find a new, 
projected domain X' of vertex 72. The domain of vertex 
72 is then projected back to leaves 70 using the 

25 auxiliary projection functions of the operator of vertex 
64, in order :o find the final values of input domains 
B':, B' m . This method is efficient, in that it 

actuates each of the auxiliary projection functions in 
the tree no more than once. Preferably, when a 

30 projection is performed repeatedly with similar inputs, 
operators whose input sets were not modified by the 
projection are identified in order to avoid actuating 
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their auxiliary functions unnecessarily, thus enhancing 
the efficiency of the method still further. The method 
can also be shown, like the atomic operator projection 
algorithm described above, to generate projections that 
5 meet the criteria of solution preservation and 
minimization. 

When a given relation in the hyper-arc is not 
simply-supported, however, as in the example of graph 52 
shown Fig. 5, the method of Fig. 7 will not necessarily 

10 give a minimal solution for the variable domains. 
Nevertheless, it is possible in some important cases to 
transform complex graphs, such as graph 52, into trees 
that will then give minimal solutions. For example, if 
any variables that are common to more than one relation 

15 in the graph (such as vertex B in graph 52) have a 
singleton input set, the method of Fig. 7 will still give 
a minimal solution. Similarly, if any of the 

intermediate sets (such as XI or X2 in graph 52) is found 
to reduce to a singleton after projection from the 

20 variables in a lower tier of the graph, the solution will 
also be minimal. 

Figs. 8A through 8D are graphs that schematically 
exemplify a method for decomposing a complex relation 
into a tree, in accordance with a preferred embodiment of 

25 the present invention. This method is applicable, at 
steps 34 and 36 in the method of Fig. 3, in cases in 
which the relation is such that an intermediate set 
becomes singleton independent of the input sets. The 
graph in Fig. 8A symbolizes the relation R = {(a,b,b,c) : 

30 (a = b) a (b = c) } . To construct the graph, R is 
restated as {(x,b,c) : (b = c) a x}, wherein x is a 
Boolean variable with intermediate set Xi. If R is to 



30 



38931S2 



have a non-trivial projection, then the intermediate set 
X-, must be the singleton {true}, represented in Fig. 8B by 
{t} . 

Because the X-, vertex must have this singleton value 
regardless of the inputs, it can be duplicated as two 
separate nodes, each with the value {t}, as shown in Fig. 
8C, without affecting the other domains in the graph. It 
is now possible to reorder the graph in the form of a 
tree, as shown in Fig. 8D. Now, b serves as an 
intermediate variable for implementing the method of Fig. 
7 on this restructured tree. First, the operator is 

projected onto domain B of b, using A and "true" as 
inputs. The reduced domain B after this step will be B* 
<— A n B . B* and C are then projected onto the next 
intermediate variable X 2 . Projection of this variable, in 
turn, on the "and" (a) operator reduces its domain X 2 ' to 
ft}. Projecting X 2 ' back down the tree gives the output 
domains A' , B r and C , which all reduce to A o B n C as 
expected. 

Although for the sake of clarity, a very simple 
relation was used in the example of Figs. 8A-8D, the 
method exemplified by these figures may be used in any 
case in which analysis reveals a singleton intermediate 
structure. In such a case, as described above, the graph 
of the complex relation is restructured so that the 
variable that is common to multiple operators is treated 
as an intermediate variable, despite its being in 
actuality an independent variable. This restructuring 
enables the graph to be treated as a tree, according to 
the method of Fig. 7, without changing the solution 
domains of the variables. 
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In some cases, even when a given relation R is 
complex- supported and not given to minimal solution by 
the method of Fig. 7, it can be broken into a disjunction 
of sub-relations of the form R = R-, v R 2 v ... v R m/ wherein 
5 each of the sub-relations R 3 is minimally solvable. A 
simple example of such a relation is one in which one of 
the variables is a common input variable to two different 
operators in the relation and has a non-singleton, 
discrete input set. If the input net of the common 

10 variable can be enumerated as a reasonable number of 
values, for example B = {bi, b 2 , b 3 }, then the relation R 
can be broken into three disjoint sub-relations, Ri, R 2 
and R 3 , each using a different, respective one of the 
input values of the variable b. Now the singleton input 

15 set solution described above can be used to find the 
separate projections of Ri, R 2 and R 3 on the other 
variables of R. The full projection of R is simply the 
union of the separate projections of the sub-relations. 

This procedure can be used generally whenever R can 

20 be expressed as a disjunction of solvable sub-relations. 
It is not necessary that all of the sub-relations have 
the same support, i.e., some or all of the sub-relations 
may involve different subsets of the variables of R. 
Even if a variable aj is not in the support of a given 

25 sub-relation R._, the projection of this sub-relation is 
extended to include an output set A/. If the output sets 
of the support variables of R x are empty, then A/ is also 
empty. Otherwise, A/ <- . As in the case of variable 
enumeration, the full projection of R is then union of 

30 the projections of all of the sub-relations. 

Fig. 9 is a flow chart that schematically 
illustrates a general method for projecting an arbitrary 
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expression containing logical and Boolean operations onto 
the domains of its variables, in accordance with a 
preferred embodiment of the present invention. This 
method enables the concepts of hyper-arc consistency, 
5 used in the method of Fig. 3, to be applied efficiently 
to a wide range of expressions. It is based on the 
property that all Boolean expressions can be converted to 
an equivalent disjunctive normal form (DNF) . The clauses 
of the DNF expression, known as v, minterms," are chosen so 

10 that they can be projected using the mechanisms of the 
present invention. Turton provides a helpful description 
of Boolean minimization techniques using the DNF in an 
article entitled "Extending Quine-McCluskey for 
Exclusive-Or Logic Synthesis," in IEEE Transactions on 

15 Education 39:1 (February, 1996), pages 81-85, which is 
incorporated herein by reference. 

At an input step 90, system 2 0 receives an arbitrary 
Boolean relation R, made up of Boolean operators. The 
inputs of the operators can be either Boolean variables, 

20 outputs of other Boolean operators, or relational 
operators having non-Boolean inputs. A corresponding 
Boolean relation R b0 oi is constructed, all of whose inputs 
are Boolean, at a construction step 92. R b ooi is generated 
by substituting a new Boolean variable b t for every 

25 relational operator opi in R. (For example, the relation 
[a = b or (c = d and e > f ) ] would be replaced by xl and 
(x2 or x3), wherein xl, x2 and x3 stand for the 
relational sub-expressions they replace.) A set of all 
of the minimal minterms of R b ooi is found, at a minterm 

30 finding step 94, using the first phase of the 
Quine-McCluskey algorithm, as described in the 
above-mentioned article by Turton. Every minterm is a 
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conjunction of several relation operators and Boolean 
variables (or their negation) from the original relation 
R. 

A weight is determined for each of the minterms, at 
a weighting step 96. The weight of each minterm is the 
estimated cost of computing its projection, using the 
methods described above. A set of minterms is found 
whose disjunction is equivalent to R b0 oi, and which has the 
minimum cumulative weight. If there is a large number of 
possible minterms, an approximate algorithm can be used 
to minimize the weight, as is known in the art. The 
projection of each of the minterms in the set onto its 
respective variables is found, at a projection step 98, 
using the methods described hereinabove. Rbooi/ and hence 
R, is then projected by taking the union of all of the 
projected domains of the variables, at a union step 100. 

In the preferred embodiments described herein, 
system 2 0 is assumed to apply the methods of the present 
invention to all of the constraints in a constraint 
network. In other embodiments, however, the system may 
be configured to process some of the constraints using 
the projection methods described above, while other 
constraints in the network are expressed and processed 
using other methods known in the art, such as methods 
based on explicit representation of all tuples. 

It will thus be appreciated that the preferred 
embodiments described above are cited by way of example, 
and that the present invention is not limited to what has 
been particularly shown and described hereinabove. 
Rather, the scope of the present invention includes both 
combinations and subcombinations of the various features 
described hereinabove, as well as variations and 
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modifications thereof which would occur to persons 
skilled in the art upon reading the foregoing description 
and which are not disclosed in the prior art. 
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